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(54) Intelligent digital television receiver 



(57) An Intelligent digital television receiver for re- 
ceiving a video signal, an audio signal and a digital data 
transmitted In a digital broadcast, and for executing an 
application based on the received digital data by itself 
or in connection with the received video and or audio 



signal. The receiver has a controller for controlling exe- 
cutions of applications by generating events according 
to event start information bearing time information con- 
tained in a digital data stream as an object which com- 
prises an element of the application and another con- 
troller for controlling executions of the application. 
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Description 

The present invention relates to a television receiv- 
er for receiving the broadcast wave to process the data 
contained in the broadcast wave and the picture signal 
for display, and provide the additional information to the 
viewer, and nfiore particularly to a so-called two-way tel- 
evision receiver which is having the response function. 

Recently, according to the progress of the semicon- 
ductor technique and the communication technique the 
television receiver having higher function have been de- 
veloped. Especially, compared with the conventional 
passive TV to just enjoy viewing the picture or audio sig- 
nal, the television receiver having the higher function 
that it adds more than the picture and the audb infor- 
mation by multiplexing the digital data by using the dig- 
ital technique, or it can response to the TV program be- 
comes to be desired. 

As the TV which realize such functions mentioned 
above, there is a Compact Graphical Interactive Broad- 
cast Information System mentioned on the International 
Application Published under the patent cooperation 
treaty (PCT) International Patent Class: H04N1/0O. In- 
ternational Publication Number; W096/3466. This doc- 
ument 1 shows the ways to realize the two-way function 
by multiplexing not only the normal image data but the 
new data to the TV program. Further, this document 
shows the way to realize the two-way function by multi- 
plexing the data on the vertical retrace interval which is 
called VBI (Vertical Blanking Interval). 

FIGURE 8 shows the construction of the transmis- 
sion side and the receiving side mentioned on the doc- 
ument. 

An image signal input from an input terminal on the 
transmission side is supplied to an inserting device 3 by 
an NTSC encoder 2. On the other hand, data for giving 
a new sen/ice are input from an input terminal 6, and the 
data are encoded in a data encoder 7. then supplied to 
the inserting device 3. To the data encoder 7 a timing 
signal is supplied from an information update device 8. 
The audio signal is omitted to simplify this explanation, 
however, it is also encoded in the same way as the video 
signal. In the Inserting device 3 one signal is formed by 
the inserting of the data. The signal is modulated by in- 
put in a modulator 4, then output from an output terminal 
5. 

On the other hand, on the receiving side, the signal 
output from the transmitter is received in an input termi- 
nal 20= then demodulated in a demodulator 21 . The de- 
modulated signal is input to an extractor 22. where the 
data are extracted. And, the output signal of the demod- 
ulator 21 is decoded by input in an NTSC decoder 23. 
The extracted data are taken in a memory 30 via a bus 
27 which is connected to a CPU 26 so as to be proc- 
essed by the software which is driven by the CPU 26. 
To the bus 27 an image memory 33 is connected, where 
the result ot the data decoding is displayed as the Image. 
And to the bus 27 a photoreceptpr 31 for receiving the 



output signal of a remote controller 32, so as to transmit 
the response of the user and change the processing of 
the software. 

To the bus 27 a transmission and receiving device, 
s so called a modem 29 is connected, where the response 
of the user is sent back to the server via a terminal 28. 
In the modem 29 it Is also possible to receive the data 
from the sen/er by the network. 

The output signals from the NTSC decoder 23 and 
10 the Image memory 33 are syrithesized by input to a syn- 
thesizing device 24. then output from an output terminal 
25. Accordingly, the graphical application constructed 
by the data which are multiplexed with the video signal 
is synthesized, so that it is possible to receive and dis- 
play the TV program which sends the complement in- 
formation or the response of the prograrn back. 

Further this DRAWING shows the construction of 
the server. The signal output from the terminal 28 on the 
receiving side is input to a terminal 11, then input to a 
sen/er 9 via a modem 10. Here, the server is not only 
for receiving the signal from the receiving side but for 
transmitting the data to the receiver In case of output- 
ting the data from the sen/er 9, the data are output from 
the terminal 11 via the modem 10. then received in the 
terminal 28 on the receiving side. Accordingly, the data 
are flowed in two-way between the terminal 11 and the 
terminal 28. 

FIGURE 29A shows the construction of the screen 
constructed by the devices mentioned above. On the 
display screen the.graphic image which is made by de- 
coding the data is displayed with the video signal. On 
the document mentioned above the section where one 
picture is displayed by forming one picture and decoding 
the data is referred as the object. Further, the actual im- 
age or text which are displayed as the object is referred 
as the resources, and the document which mentions the 
operations of the object or form is referred as the script. 

Further, the consecutive program which is con- 
structed by these forms is referred as the application. 

FIGURE 29B shows the relation of the elements 
constructing these applications. The whole applications 
are defined a specific form called the application form. 
The applicatbn form shows the numbers or construction 
of the whole forms, objects, resources, and scripts 
which are used for the application. The application form 
prescribes which form is used next. In each form an ob- 
ject construction one form is defined. In the object the 
resources and the pointer of the script showing the con- 
tent of the object are shown. One application is con- 
structed by the constructions mentioned above. 

Further, the document mentioned above shows that 
the transmission is executed by storing each element in 
the record when these elements are transmitted. 

FIGURE 30 shows the stratum constructions of the 
record and the application. The information of the appli- 
cation form defining the whole application is transmitted 
by an application header record 41 , where the infornna; 
lion showing the script and form which is carried out first 
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in the application is stored. The information of the form 
is stored in a form record 42. where the numbers show- 
ing the object and the resources used lor the object and 
the position information showing the script are con- 
tained. 

All scripts are collected into one and transmitted by 
a script record 43. In case of the resources, the resourc- 
es are transmitted by resource records 44 and 45, re- 
spectively. 

- These records are divided into the transmission 
units called blocks, then these are transmitted after the 
headers of the blocks are added to them. As mentioned 
above, the application in the document are constructed 
by many constructing elements. The graphical elements 
shown in the picture which construction is set up by the 
form are shown as the object. In this case, for instance, 
the operation that the user changes the content of the 
text by pushing the button is mentioned as the script. 

As described above, in the two-way television sys- 
tem shown in the document, one application is divided 
into several construction elements and transmitted so 
that the data are easily multiplexed, and the interactive 
application is realized by the operation of the script. 
However there is drawbacks when this system is applied 
to the digital broadcast receiver. 

- a; (n the digital broadcast the video signal is decod- 
ed by the exact timing. However, the digital broadcast 
does not have a synchronizing function by decoding the 
graphical elements of the application and the digital im- 
age signal. Accordingly, the timing control style to dis- 
play by executing the application related with the video 
signal which is constructing the TV program is not de- 
fined exactly. In the conventional embodiment since 
there is no relationship between the video signal and the 
data to be multiplexed, the display timings of the video 
signal and the decoded data are not defined. 

Further, in the conventional embodiment, since the 
operation of the application is decided by the script it is 
necessary to make the script when the application is 
make. The conventional embodiment does not provide 
the effective function to use the stream in the digital 
broadcast and to provide the application which does not 
always need the script. 

b; In the digital broadcast, since the capacity of the 
transmission protocol will be expanded it is considered 
that the function is updated by the download function on 
the receiving side. On the other hand, in the convention- 
al embodiment, the text or the bitmap data are defined 
as the resources, however, since these decoding func- 
tion is fixed there is no flexibility. That is, there is no 
countermeasure to correspond to the compression al- 
gorithm of the bitmap image having better compression 
efficiency for the future. 

Further, there is no consideration for the adding 
function of the application program to add the specific 
function. 

c; Usually, the TV receiver has a function foi' param- 
eter set up of the receiver of protocol display called OSD 



(On Screen Display). The digital broadcast needs the 
EPG (Electronic Program Guide) to select an appropri- 
ate protocol by the user since the number of the proto- 
cols will be expanded in accordance with an increase of 
s protocols. Accordingly, having these two-function sepa- 
rately in the TV receiver causes the cost up of the TV 
receiver. Further, the effective way to use the EPG func- 
tion is not provided in the conventional embodiment. 

d; In the digital broadcast the video, audio, and data 
are transmitted by the transport stream prescribed by 
ISO/IEC 1 3818-1 (document 2) called the l\y1EPG 2 sys- 
tems. This prescription shows the way to execute the 
function on the receiving side by several information 
which are defined in the stream, however, since the 
transmission way shown in the conventional embodi- 
ment has no relation with the transport stream it does 
not use the information prescribed in the stream effec- 
tively. 

. e: In the conventional embodiment, the data are re- 
ceived by a so-called carousel system which transmits 
the data repeatedly. In the digital broadcast the data are 
also transmitted repeatedly by the data carousel system 
of the DSM-cc prescribed in the ISO/IDC 13818-6 (doc- 
ument 3), so that the conventional embodiment does not 
use the information defined in the stream to execute the 
data carousel system in the digital broadcast effectively. 

f; In the digital broadcast the image format is not 
only one, but many horizontal and vertical resolutions 
are defined. Though the image compressing form is pre- 
scribed in the ISO/IEC 13818-2. the image formats are 
different by the profiles or levels. 1 n the conventional em- 
bodiment the synthesizing display of the image is 
shown, however, there is no way to correspond to the 
different image format flexibly. The position of the coor- 
dinates of the object is changeable by the display 
processing, and the compressing expansion processing 
of the bitmap image can be executed by inserting re- 
peatedly or thin down the pixel. However, this way of 
compressing expansion of the image causes the re- 
markable image deterioration. 

It is, therefore, an object of the present invention is 
to provide a digital broadcast TV receiver which can 
solve the drawbacks mentioned above. 

Another object of the present invention is to provide 
an intelligent digital television receiver which is receive 
the data multiplexed with the video or audio transmitted 
on the digital broadcast, and executes the new service 
by these video, audio or data. 

In order to achieve the above object, an intelligent 
digital television receiver according to one aspect of the 
present invention for receiving a video signal, an audio 
signal and a digital data transmitted in a digital broad- 
cast, and executes an application either executing to- 
gether with a video or audio or executing independently, 
has a controller for controlling executions of applications 
by generating events according to event start informa- 
tion bearing time information contained in a digital data 
stream as an object which comprises an element of the 
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application and another controller for controlling execu- 
tions of the application. 

Additional objects and advantages of the present 
invention will be apparent to persons skilled in the art 
from a study of the following description and the accom- 
panying drawings, which are hereby incorporated in and 
constitute a part of this specification. 

For a better understandings of the present invention 
and many of the attendant advantages thereof, refer- 
ence will now be made by way of example to the accom- 
panying drawings, wherein: 

FIGURE 1 is a diagram showing the system con- 
struction related to the present invention; 
FIGURE 2 is a diagram showing the first embodi- 
ment of the application decoder; 
FIGURE 3 is a diagram showing the construction of 
the multiplexed data; 

FIGURE 4 is a diagram for explaining the operation 
executed by the event; 

FIGURE 5 is a diagram showing the stratum con- 
struction of the application;. 
FIGURE 6 is a diagram showing the continuous re- 
source update in the second embodiment; 
FIGURE 7 is a diagram showing the construction of 
the application decoder in the third embodiment; 
FIGURE 8 is a diagram showing the data construc- 
tion of the resource decoder; 
FIGURE 9 is a diagram showing the construction of 
the application decoder in the fourth embodiment; 
FIGURE 10 is a diagram showing the construction 
of the hardware resource decoder in the fifth em- 
bodiment; 

FIGURE 11 is a diagram for explaining the data 
processing of the hardware resource decoder in the 

fifth embodiment; 

FIGURE 12 is a diagram showing the construction 
of the hardware resource decoder in the sixth em- 
bodiment: 

FIGURE 13 is a diagram for explaining the data 
processing of the hardware resource decoder in the 
sixth embodiment; 

FIGURE 14 Is a diagram for explaining the video 

resource: 

FIGURE 15 is a diagram for explaining the EPG ap- 
plication in the seventh embodiment; 
FIGURE 16 is a diagram showing the construction 
of the application decoder in the eighth embodi- 
ment; 

FIGURE 17 is a diagram showing the construction 
of the execution program and the display screen; 
FIGURE 18 is a diagram showing the construction 
of the application decoder in the ninth embodiment; 
FIGURE 19 is a diagram showing the construction 
of the OSC function decoder; 
FIGURE 20 is a diagram for explaining the conver- 
sion of. the prior information; 
FIGURE 21 is a diagram showing the conversion of 



the prior information, and the data construction con- 
version of the first transmission protocol; 
FIGURE 22 is a diagram showing the conversion of 
the prior information, and the data construction con- 
5 version of the second transmission protocol; 

FIGURE 23 is a diagram showing the format defin- 
ing the data download; 

FIGURE 24 is a diagram showing the construction 
of the figure information transmitter: 

10 FIGURE 25 is a diagram showing the construction 
of the figure information transmitter; 
FIGURE 26 is a diagram showing the construction 
of the figure information receiver; 
FIGURE 27 is a diagram showing the construction 

15 of the figure information receiver; 

FIGURE 28 is a diagram showing the construction 
of the'conventional data transmission receiving sys- 
tem; 

FIGURE 29 is a diagram showing the construction 
20 of the application: and 

FIGURE 30 is a diagram showing the construction 
of the application by the record. 

The present invention will be described in detail with 

25 reference to the FIGURES 1 through 27. 

FIGURE 1 A shows the construction of the transmis- 
sion side, and FIGURE 1 B shows the construction of the 
receiving side. A video signal input from an input termi- 
nal 101 is encoded in a video encoder 102, then it is 

30 supplied to a multiplexer 1 03, where data for executing 
a new servir iput from an input terminal 106, and en- 
coded in a c encoder 1 07 are supplied to. The audio 
signal is not .plained here to simplify the explanation, 
however, it is multiplexed in the multiplexer 103 in the 

35 same way as the video, then one signal is formed in the 
multiplexer 103. The output signal is modulated in a 
modulator 104, and output from an output terminal 105. 

An information update device 108 updates the re- 
sources which are the application elements one after 

40 another. The resources output from the information up- 
date device 108 are supplied to the data encoder 107 
to update the resources. 

On the other hand, on the receiving side the signal 
output from the transmitter is received in an input termi- 

45 nal 120, then the received signal is demodulated in a 
demodulator 121. The demodulated signal is input to a 
separator 1 22, where the video signal is separated from 
the data. The video signal is decoded In a video decoder 
1 23. The separator 1 22 is controlled by the data gener- 

50 ated in a CPU 126. The data separated from the video 
signal are taken in a memory 130 via a bus 127 con- 
nected to the CPU 126, so that the data processing is 
executed by the software driven by the GPU 1 26. To the 
bus 127 an image memory 133 is connected, which is 

55 used for displaying the result of the data decoding as 
the image. And to the bus 127 a photoreceptor 131 for 
receiving the output signal from a remote controller 1 32 
is connected, so as to transmit the response of the user 
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to the CPU 126 and change the processing of the soft- 
ware. Further, to the bus 127 a modem 129 is connect- 
ed. 

This is for sending the response of the user back to 
the server via a terminal 128. The modem 129 is also 
possible to receive the data from the server via a net- 
work. 

•The output signals from the video decoder 1 23 and 
the image memory 133 are input to a combiner 124, 
where the images are synchronized. The synchronized 
signal is output from an output terminal 125. According- 
ly, it is possible to synchronize the graphical application 
which is constructed by the data multiplexed with the 
video signal, so as to receive and display the TB pro- 
gram which can send the complementary information of 
the program or response back. 

Furthermore, FIGURE 1A shows the construction 
of the server. The signal output from the terminal 128 
on the receiving side is input to a terminal 111 , then it is 
input to a sen/er 1 09 via a modem 1 1 0. Here, the sen/er 
is not only receive the signal from the receiving side but 
send the data to the receiver. In case of output the data 
from the server 1 09 the data are output from the terminal 
111 via the modem 110, then these are received in the 
terminal 128 on the receiver side. Accordingly, the data 
flows in two-way between the terminal 111 and the ter- 
minal 128. 

FIGURE 2 shows the main parts of the first embod- 
iment according to the present invention. 

FIGURE 2 shows the construction of the application 
decoder. The application decoder Is operted by the soft- 
ware executed by the CPU 126 and the memory 130 
shown in FIGURE IB. 

An event such as "the button is pushed, or the timer 
passes 2 seconds' is Input from an input terminal 201. 
Concretely, the event is the data which is output from 
the remote controller 132 is received In the photorecep- 
tor 1 31 or which are output from the timer inside of the 
CPU 126. In the conventional embodiment, the event* 
executes the script, so as to carry out the Interactive op- 
eration. Accordingly, when a switch 204 is changed to 
the terminal A it executes the same operations as the 
conventional embodiment, so that it maintains the com- 
patibility. 

First, the compatible operations with the application 
in the conventional embodiment will be explained 

1 ; The application elements are Input from an input 
terminal 210. From the input data a buffer 211 stores 
the script to a script register 208. the resources to 
a resource register 212, and the object to an object 
defining portion 213. Accordingly, the preparation 
for displaying the application is over. 
2; An interpreter 206 interprets the stored script and 
outputs the control signal which controls the oper- 
ation to a controller 207. The controller 207 outputs 
the control signal which start the display to a re- 
source decoder 209 by the Input control signal. 



3; The resource decoder 209 decodes the resourc- 
es stored in the resource register 212 and outputs 
the image or text to a display controller 215. 
4; The image data processing In the display control- 
s ler 21 5 are output to an output terminal 216. 

Here, the output terminal 216 is the input portion to 
the Image memory 133 as the hardware in the FIGURE 
1 B. And, the input terminal 21 0 is the input portion of the 
data output from the separator 122. 

According to the operation described above, it is 
able to display and execute the application mentioned 
in the conventional embodiment. 

On the other hand, the controller 207 changes the 
switch 204 to a terminal B by the control signal output 
from an event setter 214. In this case the application is 
executed by the following operations. 

(1) The data which is separated from the transport 
stream are input from an input terminal 202. From 
the input data, for instance the time information is 
taken out in a data separator 203. The data sepa- 
rator 203 executes the separating operations in the 
condition which has been decided beforehand in 
the event setter 214. 

(2) The data taken out of the data separator 203 are 
output to an event detector 205, where a specific 
control signal is generated. Then the signal is output 
to the controller 207. 

(3) The controller 207 Inputs the event data output 

from the event detector 205 to the event setter 214, 
and it takes the control information which has been 
set up beforehand in from the event setter 214. 

(4) The controller 207 controls the display controller 
215 according to the information of the object defin- 
ing portion 213, so that the preparation of the dis- 
play Is over. 

(5) Further; the controller 207 outputs the control 
signal to the resource decoder 209, which decodes 
the resources stored in the resource register 212, 
so as to execute the display control. 

As mentioned above, it is able to start the applica- 
tion display directly by the time Information for instance 
contained in the data of the digital broadcast. 

FIGURE 3 shows the data construction multiplexed 
in the digital data broadcast in the stratum. 

Application elements 301 such as the forms, the ob- 
jects, the resources or the scripts are stored in their cor- 
responding records 302. One of the records is encoded 
over several blocks 303 (FIGURE 3 exemplarily shows 
one block to which the block header is added). The block 
303 is divided more to accord to the transmission stand- 
ard and converted into the transport stream TS In 188 
bytes length to be multiplexed. 

To the transport stream TS the data such as the vki- 
eo or audio are also multiplexed, where the time infor- 
mation Is stored. 
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FIGURE 4 shows the operation of the first embod- 
iment according to the present Invention. 

The multiplexed data shown in FIGURE 3 are de- 
coded in a form of a video data 401 which Is continuously 
reproduced as an image. The stored time information is 
transmitted at specific timings shown as 402, 403, and . 
404. Accordingly, to process the time information as the 
event the application is executed at the timing synchro- 
nized with the video signal shown as the operation 1, 
operation 2, and operation 3. 

In the first embodiment according to the present in- 
vention, the application operation is started by the time 
information as the event. However, since it is able to 
multiplex other data to the transport stream TS, the ap- 
plication is able to be executed by the information be- 
sides the time information as the event or event starting 
Information in changed condition of the event setter 214 
shown in FIGURE 2. 

In this case, since it is desired that the condition is 
set up from the transmission side, the event control ob- 
ject shown in FIGURE 4B is defined and transmitted. 
Since the object is defined as the conventional applica- 
tion elements the transmission system does not need to 
be changed. 

As shown in FIGURE 5. an event control object 502 
is stored in form record 501, so as to transmit without 
changing the construction. 

FIGURE 4B shows the operation when the specific 
event is received. FIGURE 4B also shows the script ex- 
ecuted by the specific event. When the object shown In 
FIGURE 4B the application decoder shown in FIGURE 
2 executes the application by the event stored in the 
event setter 21 4 not in the object defining portion 21 3. 

According. to the operations described above, it 
does not need to make the script so as to lighten the 
burden imposed on the application producer, in addition, 
since it does not execute the script on the receiver side 
it shortens the operation time of the interpreter 206. 

If it is not the application for defining the complex 
operation, it has the advantage explained above, in ad- 
dition, it is able to execute the application related to the 
video signal since its synchronization is defined with the 
video signal. Further, since the event condition Is set up 
on the transmission side not on the user side, it is also 
possible to display the information one after another. . 

FIGURE 7 shows the second embodiment which Is 
expanded from the first embodiment. 

The second embodiment changes only the resourc- 
es by the time information as the event. In this embod- 
iment, the bitmap Image defined as the resources is syn- 
chronized with the video and displayed. However, it is 
obvious that the other text or still image can be applied 
same way. 

The resource data input from an input terminal 601 
are input to the application decoder shown in FIGURE 
2 one after another from switches 602, 607, and buffers 
603, 604. Here a version comparator 605 checks that 
the resource version is updated and rewrites the old re- 



sources. The information which version is checked is in- 
put to a controller 606. The controller 606 controls the 
switches 602. 607 to control the writing in and reading 
out mutually by the buffers 603. 604. The output signal 
s output from either of the buffers 603, 604 is input to the 
input terminal210 of the application decoder via the 
switch 607. The control signal (for instanced the time 
information) from the application decoder is input to the 
controller 606 from an output terminal 220. The control 
signal controls the timing to change the buffers based 
on the time infomiation of the application decoder. 

The operations explained above will be explained 
in reference to the FIGURE 6C. Th data of the buffers 
A and B are read out for periods 620. 621 and 622 in 
synchronous with clock pulses 610, 611, 612 and 613. 
According to update the data one after another it is pos- 
sible to produce the animation by synchronizing the 
graphic image such as the bitmap with the video signal. 
Further, if the timing of the buffer is changed by adjusted 
to the CPU efficiency it is possible to produce the ani- 
mation having a lower flame rate. For instance, it is pos- 
sible to change the object in the sub picture so as to 
show it animated. 

This object as shown in FIGURE 68. is easily trans- 
mittable by the object having the event condition based 
on the time information and resource number. The re- 
sources themselves are manageable by the resource 
number and the version number. 

FIGURE 7 shows the third embodiment. 
The third embodiment has a feature that it is able 
to freelychange the decoding of the resources. The third 
embodiment differs from the second embodiment by 
that it includes three switches 702, 703. and 704 and a 
resource decoder 701 divided into a decoding program 
register and a decoder. 

In the embodiment the following operations are ex- 
ecuted. 

1 . The application elements are input from the input 
terminal 210. From the input data, the buffer 211 
stores the script to the script register 208, the re- 
sources to the resource register 21 2, and the object 
to the object defining portion 213. 

2. Next, according to the control signal output from 
the object defining portion 21 3, the /esource decod- 
er execution program for decoding the resources is 
stored in the a decoder program register 701. So 
that, the preparation of the application display is 
over 

50 3, According to the control information of the object 
defining portion 21 3. it judges whether the resourc- 
es are decoded by the execution program which the 
resource decoding is down loaded in the controller 
207 or by the built-in decoder, so as to control the 

55 switch 702, 703, and 704. In case of using the down 
loaded decoder it changes the switch to the terminal 
B. The resources themselves can be decoded in 
several kinds of programs. 
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FIGURE 8 is explaining the down load data of the 
resource decoder related to the third embodiment. 

The resource numbers stored in an object 801. and 
the decoder numbers showing the record which is stor- 
ing the execution program for decoding the resources 
are stored in the object defining portion 21 3. In referring 
to the object 801, Its corresponding resource 803 and 
record 802 where the resource decoder execution pro- 
gram Is stored are taken in the decoder and decoder 
program portions at the same time, so as to start the 
operations mentioned above. 

^FIGURE 9 shows the fourth embodiment. The dif- 
ference from the third embodiment is that it uses a hard- 
ware decoder interface 901 as substitute for the re- 
source decoder execution program. The hardware de- 
coder interface 901 can output the control signal from 
an output terminal 902 in case of need. The other differ- 
ence from the third embodiment is that the external ter- 
minal 903 is added to. Since other elements are same 
as the third embodiment, these are assigned with the 
same marks. 

;ln the fourth embodiment the following operations 
are executed. 

;1 ; The application elements are input from the input 
:termlnal 210. From the Input data the buffer 211 
stores the script to the script register 208, the re- 
sources to the resource register 212, and the object 
to the object defining portion 21 3. 
2; Next, according to the control signal output from 
the object defining portion 213, it decides to use 
whether the external hardware or the internal de- 
coder as the resource decoder for decoding the re- 
sources. In case o1 using the internal decoder, it ex- 
ecutes the same operations as the first embodi- 
ment. 

3; In case of using the external decoder, the control 
signal to the external hardware in a hardware de- 
coder interface 901 is output from an output termi- 
nal 902. 

4; The resources decoded by the external hardware 
are received in an input terminal 903 and stored in 
the resource register 212 via the buffer 211. The 
stored resources are output via the switch 704 and 
the hardware decoder interface 901. 
5; The controller 207 controls the switches 702. 703 
and 704 based on the control information of the ob- 
ject defining portion 213 at the display timing. In 
case of using the hardware decoder the switch is 
changed to the terminal B. 

As explained above, the fourth embodiment is op- 
erated as the hardware having the resource decoder 
outside. 

FIGURE 1 0 shows the construction of the hardware 
shown in fourth embodiment. 

in FIGURE 10, a video processor 1000 and a mem- 
ory 1001 are added after the video decoder 1 23 to the 



construction of the receiver shown in Fl GURE 1 B. When 
the image output form the video decoder 123 is input to 
the video processor 1000, the video processor 1000 ex- 
ecutes a specific processing according to the control 
5 signal output from the CPU 1 26. Here, the output signal 
input to the video processor 1000 is the signal output 
from the terminal 902, as shown in FIGURE 9. However, 
since the application decoder shown in FIGURE Is con- 
structed by the software, the control signal is output to 
10 the video processor 1000 as the signal output from the 
CPU 126. The picture processor 1000 holds the video 
one by using the memory 1001 . then it transfers the im- 
age data to the image memory 133 via the bus 127 
based on the CPU 126. The image data are same as 

'5 the decoded resources which are input to a terminal 903 
in FIGURE 9. The separator 122 outputs the resource 
data using the hardware resource decoder to the video 
decoder based on the control signal of the CPU 126. 
Other data are input to the memory 1 30 via the bus 1 27. 

20 FIGURE 11 shows more detailed operations of the 
fourth embodiment. 

Respective data 1101 shown in FIGURE 11 are the 
application elements contained in the transport stream. 
In this embodiment, a resource data 1102 which is pos- 

25 sible to use the hardware resource decoder are consid- 
ered as the video data to be shown in the video data, so 
as to be separated from other application elements. The 
resource data 1102 considered as the video data are 
decoded in the video decoder 123, so that the output 

30 signal Is input to the video processor 1000. The output 
signal from the video processor 1000 is input to an ap- 
plication decoder 1106 realized by a software. 

According to the fourth embodiment, since the de- 
coding of the resources are executed by the hardware 

3S it shorten the display time. Usually in the digital broad- 
cast receiver, since the video decoder executes the 
compressed decoding by the MPEG-2 the resources 
are compressed by I flame form of the fy/IPEG-2, so as 
to realize the functions explained above. In this case. 

40 the video processor 1 000 needs just the function to buff- 
er the image of IVIPEG-2, so that the actual hardware Is 
a small scaled. 

FIGURE 1 2 shows the fifth embodiment which is ap- 
plied to the fourth embodiment. 

45 The differences from the fourth embodiment is that 
the video processor is replaced by a video compandor 
1201, and the decoded image signal is not output to the 
bus 127. In this embodiment, the image signal decoded 
in the video decoder 123 is output to the combiner 124 

50 via the video compandor 1201 directly. The video com- 
pandor 1201 compresses the Image and displays it on 
the specific picture position based on the picture posi- 
tion information stored in the input object data and the 
picture size information. 

55 FIGURE 1 3 shows the operations. 

The difference form FIGURE 11 is that the output 
form the video decoder is input to the video 
compandor(201 , and the outputs output separately from 
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the output of the application decoder. That is. In case of 
displaying the resources separately from the application 
decoder only the object information which is decided by 
the application decoder Is applied to the hardware, so 
as to construct the application. For instance in case that 
the resources are defined as the moving picture, the 
graphical data displayed as the object is animated, so 
that it can get the same effect as PIP (Picture in Picture). 

FIGURE 14A shows more detailed operations. 

A video object 1 401 is defined newly, where the ob- 
ject number, the picture display position, the picture size 
and the resource number are stored. In a resource 1 402 
shown by the resource number the resource number, 
the protocol number and the stream ID are defined. 

The fifth embodiment is operated by the application 
decoder of the fourth embodiment shown in FIGURE 9. 
The video object input the information to the controller 
207 from the object defining portion 213. The controller 
207 outputs the control signal to the hardware decoder 
interface 901. Then the information is output to the ex- 
ternal hardware from the output terminal 902. The coor- 
dinates and the size information defined in the object 
are output to the video compandor 1 201 and output to 
the stream ID separating decoder 122. 

The picture shown in the sixth embodiment is 
shown in the FIGURE 14B. An object 1405 such as a 
usual text is processed in the application decoder and 
output. The frame of a video object 1406 is processed 
and output by the application decoder. However, the im- 
age displayed in the video object is displayed directly by 
the output of the video compandor 1 201 as the video 
resources. 

FIGURE 15 shows the expanded figure of the sixth 
embodiment. 

Like a form 1510 as shown in FIGURE 15B, in case 
that the form contains several video objects each video 
objects realize the ERG function. For instance, when to 
a stream 1500 shown in FIGURE 1 5A the form is trans- 
mitted, where the stratum stream objects of streams 
1 501 , 1502 and 1 503 are exist, the table of the present 
programs is constructed in an exemplified picture 1504 
as shown in FIGURE 15C. Further a large quantity of 
the program contents are shown as the text, the pro- 
gram table corresponding to the protocols is constructed 
In an exemplified picture 1505 as shown in FIGURE 
15D. 

FIGURE 16 shows the eighth embodiment. 

The difference from the first embodiment is that an 
execution program register 1 601 , an execution program 
controller 1602, a condition table 1603 and a switch 
1 604 are added. The eighth embodiment defines the ex- 
ecution program as the resources. For instance, it down- 
loads the software for browsing of the internet and carry 
out it. 

In the embodiment, it explains about one execution 
program, however, it is adaptable to more than two pro- 
grams. In eighth embodiment the following operations 
are executed. 



(1) The application elements are input from the in- 
put terminal 210. From the input data the buffer 211 
stores the script to the script register 208, the re- 
sources to the resource register 21 2, and the object 

s to the object defining portion 213. However, if the 
resources are execution programs, the resources 
are stored in the execution program register 1601. 

(2) The resources are stored in the execution pro- 
gram register 1601 based on the control signal out- 
put from the object defining portion 213. Further, the 
execution program is registered in the condition ta- 
ble to tell its existence. This table registers several 
conditions. 

(3) The execution program starts the operations ac- 
cording to the control of the execution program con- 
troller 1602. At that time, the output of the resource 

'decoder 209 is stopped, arid if is changed to the 
graphic data of the execution program as the re- 
sources. 

(4) The operations mentioned above is started, car- 
ry out is registered in the condition table 1603, and 
the operation is ended end is registered. Here, the 
event can end the operation forcibly according to 
the control of the controller 207. 

FIGURE 17A shows the definition of the record 
when the execution program is considered as the re- 
sources. In the resource 1 702 specified by the execution 
program object 1701, the information registered in the 
condition table, the control information, and the execu- 
tion program are stored. 

FIGURE 17B shows the display example 1703 re- 
alized by the execution program. It shows that the exe- 
cution program is operated and displayed inside the ob- 
ject 1704. 

FIGURE 18 shows the ninth embodiment. The dif- 
ference from the embodiment shown in FIGURE 16 is 
that a switch 1611 is provided between the buffer 211 
and the execution program register 1 601 . and the switch 
1611 is turned on only when the user gives a specific 
secret key (ID). Accordingly, the specific resources are 
adapted to toll system or parental code. 

FIGURE 19 shows the tenth embodiment. The dif- 
ference from the FIGURE 2 is that a fixed resource 
1801 . a fixed object definer 1802, and a switch 1803 are 
added. In the tenth embodiment the application is oper- 
ate by the fixed object, resources and script stored in- 
side the receiver without being transmitted. That is, it is 
possible to be used in'substitution for the OSD function 
which is peculiar to the TV receiver, and it does not need 
to have another OSD function, so as not to increase the 
hardware. Further it is possible to reduce the transmis- 
sion capacity by storing the object which is displayed at 
all times. 

The present invention is not limited to the embodi- 
ments described before, 

First, the background of other embodiment will be 
explained. In the specification (document $) lOAP Pro- 
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locol Ver.1.0 Technical Specification which is made 
based on the specification (document 1) (international 
application unveil numberW096/34466) of the informa- 
tion accompanied with the programs the information unit 
referred as the block is defined. In this block header in- 
formation there is a filed -IBH PRIORITY LEVEL show- 
ing the priority over the blocks, if the field value is 0, 6, 
or 7, the block sometimes contains the urgent message 
so as to be processed in advance. On the other hand, 
in the digital data transmission specification (document 
2) (ISO/IEC 13818-1) the data transmission unit on the 
lowest stratum referred as the transport packet is de- 
fined. In the transport packet header information there 
is the field transport priority (1 bit) showing the priority 
over the packets. When the field value is 1 it means that 
the packet must be processed in advance. 

Here, as shown in FIGURE 20, when the block 
which is the information unit is divided by adjusted to the 
packet which is the transmission unit and transmitted, 
and in case of the block having the IBH PRIORITY LEV- 
EL value is 0, 6. or 7, it is transmitted as the transport 
priority of the packet containing the elements is 1 (the 
packet having high priority). 

FIGURE 30 shows that the BL 2 has a high priority 
among the block sequence BL1, BL2, and BL3, and its 
IBH PRIORITY LEVEL is either 0, 6. or 7. Here when 
the block is divided into the packets, the data of the block 
BL2 are divided over the packets PCK1. PCK2, and 
PCK3. In this case, even if the all data of the packet are 
not BL2 the data are transmitted as the transport priority 
of the packet containing the element is 1 (the packet 
having the high priority). 

In the example mentioned above, the data are as- 
signed to the packet directly from the block. However, it 
is apparent that the case that the data assigned to the 
lowest stratum via the defined data unit in the middle is 
not departed from the principle of the present invention. 

FIGURE 21 shows that the display form information 
is divided into the block mentioned in the document 1 
(see FIGURES 21a and 21b). is converted into the 
stream of the format mentioned in the document 3 (see 
FIGURES 21c and 21d), and is converted into the 
stream of the format mentioned in the document 2 (see 
FIGURE 21 e). In this case, the information showing the 
high priority is mentioned on the lowest stratum. As 
shown in FIGURE 21 , that the data carrousel system of 
the DSM-CC which transmits the contents repeatedly 
lays in the middle is adapted to transmit the data to the 
software processing decoder (see FIGURE 11 and FIG- 
URE 1 3). Further it is adapted to the case that the script 
or important data which can be transmitted having 
enough time are transmitted. 

FIGURE 22 shows that the display material infor- 
mation is divided into the blocks mentioned in the doc- 
ument 1 (see FIGURES 22a and 22b), and converted 
into the stream of the format mentioned in the document 
2 (see FIGURES 22a and 22b). In this case, the infor- 
mation showing the high priority is mentioned on the 



lowest stratum also. As shown in FIGURE 22, when the 
display material is converted into the format mentioned 
in the document 2 directly it can be decoded in the nnain 
video decoder, so that it is effective when it is transm itted 
s as the hardware information (see FIGURE 11 and FIG- 
URE 13). 

According to the present invention, the prior 
processing information on the transmission protocol 
which transmits the program or the information accom- 

10 pan led to the program is decided based on the process- 
ing prior information of the information accompanied to 
the program. And the processing priority information of 
the information accompanied to the program may be the 
IBH PRIORITY LEVEL in the document 1 . and the pri- 

IS ority processing information on the transmission proto- 
col may be the transport priority in the document 2, or 
may be the elementary stream priority indicator in the 
document 2. 

As mentioned above, it is possible to know the data 
20 to be processed in advance by the transport packets or 
PES priority which are processed in early stratum after 
receiving, so that the information given phority can be 
processed fast. 

The present invention is not limited to the embodi- 
es ments mentioned above. 

In the document 1 which is the specification of the 
information accompanied to the program defines the in- 
formation carry out unit called the application. The ap- 
plication is assigned the unique number at the field 
30 called lAppUIC. On the other hand, in the document 3 
which is transmission specification of the digital data, it 
is transmittable by having the data units called the mod- 
ule inside the transmission unit identified by the identi- 
fication called the download ID. FIGURE 23 shows the 
35 construction of the Downloadlnfolndication field defin- 
ing the data transmission contents which is defined in 
the document 3. In the above diagram since the details 
of the each fields are shown in the document 3 these 
are omitted here. The downloadID on line 3 in the chart 
40 shown in FIGURE 23 shows the identification number 
of the defined data unit. Form the first line the module 
contained in the data unit defined by the downloadID is 
defined. In this present invention, the application is as- 
signed to the module which is the data unit. The appli- 
es cation has the modulelD which is the unique identifica- 
tion per each download ID. On the line 1 7, the moduleln- 
foByte which applies the individual Information of the 
module (here it is application) is defined. Here, the lAp- 
pUIC of the application which is corresponding to the 
50 modulelnfoByte is applied in the present invention. 

In the present invention mentioned above, the infor- 
mation showing the carry out unit of the information ac- 
companied to the program is corresponded to the infor- 
mation showing the transmission unit of the carry out 
ss unit. Here, the information showing the carry out unit of 
the Information accompanied to the program may be the 
lAppUlC in the document 1, And the information show- 
ing the transmission unit of the carry out unit may be the 



17 



EP 0 891 081 A2 



18 



modulelD in the document 3. Further, the corresponding 
means may be the means that the lAppUIC is mentioned 

in the modulelnfoByte field corresponding to any mod- 
ulelD from the Downloadlngolndication in the document 
3. 

In the conventional embodiment, when the new ap- 
plication is operated by the user, which data are kept in 
the memory for carrying out the application is not judged 
till the module is resolved Into the application after the 
data are received. However, in the present invention, if 
the application is designated by the user it refers the 
module ID from the lAppUIC and knows the data to be 
processed on the earlier stratum after receiving the da- 
ta, so as to gather the data in the memory for carrying 
out the application quickly with less processing load. 

Further, the present invention is not limited to the 
embodiments mentioned above. 

• In the document 1 which is the specification of the 
information accompanied to the program, the informa- 
tion carry out'unit called the applicatbn is defined. In 
this application, the information designs the display form 
or the information of the display material, for instance 
the image data are contained. In the document 3. the 
protocol for transmitting the data are defined according 
to the protocol shown in the document 2. As one em- 
bodiment of the present invention, the cases that the in- 
formation indicating the display form is transmined by 
using the first transmission protocol according to the 
protocol shown in the document 3, and that the informa- 
tion of the display material, for instance the image data 
is transmitted by using the second transmission protocol 
according to the document 2 are explained hereinafter. 

As shown in FIGURE 21. the display form informa- 
tion indicating the display form (FIGURE 21a) is stored 
in the block defined in the document 1 (FIGURE 21b). 
The block is stored in the block data bytes of the data 
units (FIGURE 21c) defined in the document 3. Here, 
since the block size is adjusted to the upper limit of the 
information amount of the block data bytes, the data of 
the display form information is also adjusted to the size 
to be divided, then these are stored in the block. The 
data unit (FIGURE 21c) is stored in the second data unit 
added the header (FIGURE 21 d) according to the doc- 
ument 3. The d.r ia unit is divided into the payload of the 
packet added more header (FIGURE 21 e) according to 
the document 2 and stored. 

The protocol in the document 3 provide the data car- 
ousel 

function for transmitting the fixed information unit re- 
peatedly. The display form information may be transmit- 
ted repeatedly according to the protocol. 

On the other hand, as shown in FIGURE 22. the 
display material information (FIGURE 22a) is stored in 
the block defined in the document 1 (FIGURE 22b). The 



block is divided into the payload.of the packet added the 
header (FIGURE 22c) according lo the definition of the 
document 2 and stored. The packet in which the block 
• is stored, which is the transport packet that the stream 

s type defined by the document 2 takes the value from 
0x80 to OxFF by its header, so called the private data 
packet, shows that the block is stored. 

In the present invention explained above, when the 
information accompanied tothe program is transmitted, 

10 the information amount in the information unit , or the 
transmission protocol according to the necessary trans- 
mission time are selected. In this case, the selected first 
transmission protocol may be based on the DSM-CCa 
protocol defined in the document 3, and the selected 

IS second transmission protocol may be based on the oth- 
er protocols. In this case, the second transmission pro- 
tocol may be formed by the transport packet "which the 
stream type takes the value from 0x80 to OxFF in the 
document 2, Further in this case, the information unit, 

20 when the second transmission protocol is selected, may 
be a record of the resource define type in the document 
1. 

In the present invention mentioned above the fol- 
lowing statement will be made. 

25 The protocol in the document 3 can transmit the de- 
tailed information such as the definition of the applica- 
tion. However, if the original data .are great in amount 
because of the deep data unit stratum and its limited 
size, the original data are sometimes defined and added 

30 the header per each data units. So, the data transmis- 
sion efficiency are gone down, and there is the process- 
ing load to resolve the stratum data on the receiving 
side. 

However, in the present invention, since the data 

35 having the small amount of information are transmitted 
in the first transmission protocol, and the image data 
having a large amount of data are transmitted by using 
the less stratum second protocol, it provides the detailed 
information transmission, the transmission efficiency 

40 and the decreased of the processing load. Further, since 
the former are transmitted as the private data of the doc- 
ument 3 and the latter are transmitted as the private data 
of the document 2, the final data transmission forms are 
unified to the transport packet of the document 2. so as 

45 not to prepare the other second transmission protocol. 
The summary of each points of the present inven- 
tion will be described hereinafter. 

First, in the intelligent digital television receiver 
which receives the video, the audio and the data trans- 

50 mitted in a digital broadcast, and executes the applica- 
tion either by executing together with the video or audio 
or separately, it has the object, the resources, and the 
form, and the script as the application elements, and it 
generates the event based on the event executing in- 

55 formation stored in the stream of the digital data as the 
object, so that the application is controlled. 

The object contains the specific event condition, 
based on which the application Is controlled. The re- 
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sources are updated at the timing of the event generated 
from the object. 

The resources may be updated continuously by the 
buffer control based on the event timing. Further, the re- 
sources may be decoded by the decoder program which 
is downloaded by the broadcast wave or the two-way 
network. 

Here the decoding of the resources may be execut- 
ed by the hardware decoder. In this case, the decoding 
is realized by using only the I flame decoding operation 
of the MPEG-2. The data decoded by the hardware de- 
coder may be supplied to as the input to the application 
decoding processor constructed by the software which 
decodes the application elements. , 

Further, the video data decoded by the hardware 
decoder is compressed by the information based on the 
definition of the object output from the software decoder, 
and the compressed video and the graphical object out- 
put from the software decoder are processed separate- 
ly, then each data may be synchronized. Further, it may 
have a function to make the data to the hardware de- 
coder the input data by controlling the means to sepa- 
rate the data according to the control signal based on 
the object defining iriformatlon. 

As the object at least the picture size and the display 
position may be defined. In the resources related to the 
object the protocol information and the stream ID infor- 
mation may be stored. And, as the related resource the 
text may be defined, and as the object the video display 
may be controlled. 

Further, it may be provided with a means to con- 
struct the program guide by displaying at least one of 
the several protocol Information and the semi-still image 
in order, by using the form containing several objects. 

Further, it may be provided with a condition man- 
agement table, execution program storing area and the 
function to download the execution program as the re- 
sources and control the execution program based on the 
object definition. Furthermore, it may be provided a 
means for executing the on screen display (OSD) ad- 
justing the parameter of the receiver according to the 
built-in application elements. Here the built-in applica- 
tion elements and the new transmitted application ele- 
ments may be operated together. 

Furthermore, in the digital broadcast which the pro- 
gram information is converted into the transmission for- 
mat and transmitted, the prior processing information on 
the transmission protocol is arranged in the packet cor- 
responding to the program information on the transmis- 
sion format when there is the processing prior informa- 
tion accompanied to the program information. And in the 
intelligent digital television system which digitally broad- 
casts the video, the audio, and the digital data, and ex- 
ecutes the application on the receiver side by executing 
together with the video or separately, the information 
showing the carry out unit of the information accompa- 
nied to the program is correspond to the information 
showing the transmission unit of the carry out unit. 



When the information accompanied to the program 
is transmitted, the transmission protocol for decoding is 
selected according to the information amount or the nec- 
essary transmission time per the information unit. The 
5 transmission protocol contains the first protocol based 
on the software, and the second protocol based on the 
hardware application. 

The present invention is constructed to realize the 
image improving function in case of transmitting the fig- 
10 ure Information. 

FIGURE 24 shows one embodiment of the figure 
information transmitter. The figure information as the in- 
put to the device is input to a bitmap data generator 241 . 
from which the bitmap data are output. The output bit- 
map data construct a picture by the scores of or hun- 
dreds of pixels in the horizontal and vertical direction, 
and uses one-dimenslonally arranged set of the value 
that the color information of the pixels is shown by sev- 
eral or scores of bits. On the other hand, the figure in- 
formation Is also input to a vector data generator 242, 
from which the vector data are output. The vector data 
expresses the outline of the character or picture con- 
structing the input figure, for instance It expresses the 
lines constructing the outline as a set of lines and ar- 
ranges these lines as a pair of the coordinates of the 
start point and the end point. The outputs from the bit- 
map data generator 241 and the vector data generator 
242 are input to a combiner 243. from which these are 
output as one data and transmitted. 

As the construction of the combiner 243, for in- 
stance in the inter-text system which is one of the two- 
way television systems, there is a means that it is en- 
coded as the bitmap object which buries the vector in- 
formation as the hint information. 

In the embodiment shown in FIGURE 24, the bitmap 
data and the vector data are generated from the original 
figure information. However, in the case that the figure 
information for generating the vector data is not used as 
the input from the problem of compatibility with the con- 
ventional apparatus which transmits only the bitmap da- 
ta, it may be realized by following construction. 

As shown in FIGURE 25, the input of the vector data 
generator 252 may be output from a bitmap data gen- 
erator 251 . In this case, a vector data generator 252 us- 
es the edge detection algorithm for extracting the outline 
of the figure from the bitmap data. 

According to the present invention described 
above, it is the figure information transmitter for trans- 
mitting the figure information as the bitmap form data 
and for transmitting the vector information showing the 
direction of the figure expressed by each bitmap con- 
structing pixels by adding to the bitmap form data. That 
is, the present invention is provided with the bitmap data 
generating means for generating the bitmap form data 
from the figure information, the vector data generating 
means for generating the vector data from the figure in- 
formation, and the data synthesizing means for synthe- 
sizing the generated bitmap data and the generated 
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vector data. Further the present invention is provided 
with the bitmap data generating means for generating 
the bitmap form data from the figure jnformatbn, the 
vector generating means for generating the vector data 
from the bitmap data generated in the bitmap data gen- 
erating means, and the data synchronizing means for 
synchronizing the generated bitmap data and the gen- 
erated vector data. 

FIGURE 26 shows the figure information receiver, 
to which the data which are the synthesized data of the 
bitmap data and the vector data and which are output 
of the FIGURE 24 and FIGURE 25. or the data which 
are composed of only the conventional bitmap data are 
Input. 

The input data are input to a data discriminator 261 , 
which discriminates whether the vector data are con- 
tained in the input. As the judging way, tor instance when 
the input data are the bitmap object in the inter text sys- 
tem it is judged by referring to the graph showing the 
existence of the hint information. Here, the judging de- 
vice 261 judges that the vector data are contained in the 
input, the bitmap data and the vector data contained in 
the data are taken out and input to the bitmap data scaler 
262. The bitmap data scaler 262 generates the bitmap 
data having the different constructing pixel number from 
the input out of the input bitmap data and the vector data 
and outputs them. The output is expressed as the dis- 
play on the TV screen or the printing from the printer. 

When the judging divide 261 judges that the vector 
data are not contained in the input data, the bitmap data 
scaler 262. to which only the bitmap data are input, gen- 
erates the bitmap data having the different constructing 
pixel number out of the input bitmap data and outputs 
them. Accordingly, it can receive the data transmitted 
from the conventional transmitter which does not trans- 
mit the vector data without any problems. 

In the embodiment of the receiver mentioned 
above, when the vector data are not contained in the 
input data, the bitmap data scaler 262 scales up and 
down the bitmap data from the bitmap data. However, 
when the conventional formed data containing only the 
bitmap data are received the vector data may be used 
f r the enlargement or reduction of the bitmap data. 

As shown in FIGURE 27. when the conventional 
formed data containing the bitmap data are received 
through a discriminator 271 . the data may be input to a 
vector data generator 272 for generating the vector data 
from the bitnnap data, and input to a bitmap data scaler 
274 via a switch 273. At that time the vector data are 
contained in the data, the data are input to the bitmap 
data scaler 274. 

Accordingly, the present invention is the figure in- 
formation receiver for receiving the figure Information 
transmitted by the figure information transmitter, which 
is provided with the judging means for judging whether 
the vector data are contained in the received data or not. 
When the judging means judges that the vector data are 
contained in the received data, it generates the bitmap 



data having the different constructing pixel number from 
the received bitmap out of the received bitmap data and 
the vector data. When the judging means judges that 
the vector data are not contained, it generates the data 

5 out of only the received bitmap data. 

The present invention is the figure information re- 
ceiver for receiving the figure information, which is pro- 
vided with the judging means for judging whether the 
vector data are contained in the received data or not, 

10 and the vector data generating means for generating the 
vector data from the received bitmap data. Further it 
generates the bitmap data having different constructing 
pixel numbers from the received bitmap out of the bit- 
map data and the vector data when the judging means 

IS judges the vector data are contained in the received da- 
ta, and out of the vector data output from the received 
bitm'ap'and generating means when the judging means 
judges the vector data are not contained in the received 
data. 

20 The system contains the figure information trans- 
mitting means for transmitting the figure information as 
the bitmap data, by which the vector Information show- 
ing the direction of the figure expressed by the pixels 
constructing the bitmap is transmitted by added to the 

25 bitmap data. And, it is provided with the bitmap gener- 
ating means for generating the bitmap data from the fig- 
ure Information, the vector generating means for gener- 
ating the vector data from the figure information, and the 
data synchronizing means for synchronizing the bitmap 

30 data generated in the bitmap data generating means 
and the vector data generated in the vector data gener- 
ating means. Further it Is also provided with the bitmap 
data generating means for generating the bitmap data 
from the figure information, the vector data generating 

3S means for generating the vector data from the bitmap 
data generated in the bitmap data generating means, 
and the data synchronizing means for synchronizing the 
bitmap data and the vector data. 

Further, it is provided with the judging means for 

40 judging whether the vector data are contained in the re- 
ceived data. And it generates the bitmap data having 
different constructing pixel numbers from the received 
bitmap, out of the received bitmap data and the vector 
data when the judging means judges the vector data are 

45 contained in the received data, and out of only the bit- 
map data when the judging means judges the vector da- 
ta are not contained in the received data. Furthermore, 
It Is provided with the judging means for judging whether 
the vector data are contained in the received data, the 

so vector data generating means for generating the vector 
data from the received bitmap, and the bitmap data gen- 
erating means for generating the bitmap data having the 
different constructing pixel numbers from the received 
bitmap out of the bitmap data and the vector data when 

55 the judging means judges the vector data are contained 
in the received data, and out of the received bitmap and 
the vector data generated from the vector data gener- 
ating means when the judging means judges the vector 
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data are not contained in the received data. 

As described above, the intelligent digital television 
receiver of the present invention can receive the data 
nnultiplexed with the video or the audio which are trans- 
mitted by the digital broadcast, and it is possible to ex- s 
ecute a new sen/ice by the video, the audio, or the data. 
Accordingly, the intelligent digital television receiver of 
the present invention cam improve. the functions greatly 
without adding great deal of hardware or software. Fur- 
ther, the intelligent digital television receiver of the io 
present invention can execute the application which is 
supplied in the conventional embodiment without any 
problems, and it is possible to maintain the compatibility 

As described above, the present invention can pro- 
vide an extremely preferable intelligent digital television 
receiver. 

While there have been illustrated and described 
what are at present considered to be preferred embod- 
iments of the present invention, It will be understood by 
those skilled in the art that various changes and modi- 
fications may be made, and equivalents may be substi- 
tuted for elements thereof without departing from the 
true scope of the present invention. In addition, many 
modifications may be made to adapt a particular situa- 
tion or material to the teaching of the present invention 2S 
without departing from the central scope thereof. There- 
tor, it is Intended that the present invention not be limited 
to the particular embodiment disclosed as the best 
mode contemplated for carrying out the present inven- 
tion, but that the present invention includes all embodi- 30 
ments falling.within the scope of the appended claims. 

The foregoing description and the drawings are re- 
garded by the applicant as including a variety of individ- 
ually inventive concepts, some of which may lie partially 
or wholly outside the scope of some or all of the following 35 
claims. The fact that the applicant has chosen at the time 
of filing of the present application to restrict the claimed 
scope of protection in accordance with the following 
claims is not to be taken as a disclaimer or alternative 
inventive concepts that are included in the contents of '^o 
the application and could be defined by claims differing 
in scope from the following claims, which different 
claims may be adopted subsequently during prosecu- 
tion, for example, for the purposes of a divisional appli- 
cation. 



Claims 

1 . A digital television receiver for receiving a video sig- 50 
nal, an audio signal and a digital data transmitted 
in a digital broadcast, and for executing an applica- 
tion based on the received digital data by itself or In 
connection with the received video and or audb sig- 
nal, comprising: 55 

means for controlling executions of applica- 
tions by generating events according to event 



start information bearing time information con- 
tained In a digital data stream as an object 
which comprises an element of the application; 
and 

means for controlling executions of the applica- 
tion. 

2. An intelligent digital television receiver as claimed 
in claim 1 , wherein the object includes a specific 
event condition for use in controlling the execution 

of the application. 

3. An intelligent digital television receiver as claimed 
in claim 1 , wherein the application includes a re- 
source as an element thereof, and wherein the re- 
source is updated at a timing of the event generated 
by the object. 

4. An intelligent digital television receiver as claimed 
in claim 1, wherein the application includes a re- 
source as an element thereof, and wherein the re- 
source is decoded by a broadcast wave or a decod- 
er program which is downloaded by a two-way net- 
work. 

5. An intelligent digital television receiver as claimed 
In claim 1 , wherein the application includes a re- 
source as an element thereof, and wherein the re- 
source is decoded by a hardware decoder using on- 
ly a decoding operation of 1 -frames in the MPEG-2 
I flame decoding operation. » 

6. An intelligent digital television receiver as claimed 
in claim 1, wherein the application includes a re- 
source as an element thereof, and wherein the re- 
source is decoded by a hardware decoder, and then 
image data decoded by the hardware decoder is 
compressed by the information based on the object 
definition output from a software decoder, thus the 
compressed image and a graphical object output 
from the software decoder being processed inde- 
pendently and synthesized. 

7. An intelligent digital television receiver as claimed 
in claim 1 , wherein the object defines at least a pic- 
ture size and a display position to store the protocol 
information and the ID information of the stream in 
the resource which relates to the object, and defines 
a text as its related resource for controlling the dis- 
play as the object. 

8. An intelligent digital television receiver as claimed 
in claim 1 , further comprising a function for control- 
ling a storage area of a state control table and the 
execution program,, and wherein it downloads the 
execution program as the resources to control the 
program according to the object definition. 
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9. An inlelligent digital television receiver as claimed 
in claim 1, wherein for transmitting information ac- 
companied with a program, a protocol system for 
decoding is selected according to an information 
amount and/or a necessary transmission time for 
every information unit. 

10. An intelligent digital television receiver as claimed 
in claim 9, wherein the protocol system comprises 
a first transmission protocol based on a software 
application, and a second transmission protocol 
based on a hardware application. 

11. A digital television receiver, comprising: 

judging means forjudging whether vector data 
are containedin the received data or not; and' 
data generating means for generating a bitmap 
data different in its number of pixels from the 
originally received bitmap data and a vector da- 
ta when the judging means judges that the vec- 
tor data are contained in the received data, and 
out of only the received bitmap data when the 
judging means judges that the vector data are 
■ not contained in the received data. 

12. A digital television receiver, comprising: 

judging means for judging whether a vector da- 
ta is contained in the received data or not; 
vector data generating means for generating 
the vector data from a received bitmap; 
data generating means for generating a bitmap 
data different in its number of pixels from the 
received bitmap, out of the received bitmap da- 
ta and the vector data when the judging means 
judges the vector data are contained in the re- 
ceived data, and out of the vector data output 
from the received bitmap and the vector data 
generating means when the judging means 
judges that the vector data are not contained in 
the received data. 

' 13. A digital television receiver for receiving a video sig- 
nal, an audio signal and a digital data transmitted 
in a digital broadcast, and for executing an applica- 
tion based on the received digital data by itself or in 
connection with the received video and or audio sig- 
nal, comprising: 

means for determining a transmission proto- 
col to be preferentially executed for transmitting a 
program and Information accompanied with the pro- 
gram according to a priority Information accompa- 
nied with the program. 

14. An intelligent digital television receiver as claimed- 
In claim -13, wherein the priority Information includes 
an |.BH_PRIORITY_LEVEL field for indicating an 



execution priority of blocks according to an applica- 
tion. 

15. An intelligent digital television receiver as claimed 
s in claim 1 3, wherein the priority Information includes 
a transport priority field for indicating an execution 
priority of blocks according to an application. 
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12 moduleld 2 

13 moduleSize 4 

14 moduleVersion 1 

15 modulelnfoLength 1 

16 for(l=0;i< moduleinfoLength; i++) { ' 

17 modulelnfoByte } 1 

18 } 

19 privateDataLength 2 

20 for(i=Oi i<privateDataLength: i-t-+) { 

21 . privateDataByte } 1 

} 



FIG. 23 



EP 0 891 081 A2 



2 

o 

< 

cr 
o 



q: 
o 

UL 

5 

Q. 
W 

Q 



/ 



/ 



05 
CM 

O 
LI. 




EP 0 891 081 A2 



o 



a: 
O 



o 

LU 

—3 

CQ 
O 

>- 
< 
_J 
CL 
CO 



/I 

/ 

/ 

/ 

/ 

/ 

/ / 
/ / 
/ / 
/ 

/ 

/ / 



03 
CN 

(3 



^ 



o 
o 

CQ 



L- 



/ 



/■ 



/ 



/ 



/ 



/ 



/ 



/ 



Csl 
CM 

O 



Q 
< 

o 
< 

Q. 



cr 

ILI 
Q 
< 
LU 
X 



Q 
< 

o 

_l 

> 

1 



01 
LU 
O 
< 
LU 



Q 
< 
O 
-J 
> 
< 
CL 



LU 
Q 
< 
LLI 
X 



O 
CN 
CM 

o 

LL 



EP 0 891 081 A2 



GRAPHICAL 
INFORMATION 




FIG. 24 



253 



. graphical 
information' 




FIG. 25 



EP 0 891 081 A2 



RECEIVED 
DATA 




FIG. 26 



274 



DATA 




FIG. 27 



EP 0 891 081 A2 



CO 
CM " 



in 

J. 



T 



CO 
CM 

1 



CM 
CO- 





Z) 




CL 




O 



CO 
CO- 



o 



CO. 



I 



CN 
CN 



CO 



■CD 
CN 



CN 



I 

=1 



00 

eg 

o 



CN . 



1 I ^ 00 



EP 0 891 081 A2 



APPLICATIONS 



FORM 3 



FORM 2 



FORM 1 



OBJECT 
1 



IMAGE 



OBJECT 2 



DISPLAY 
SCREEN 



FIG. 29a 



APPLICATION FORM 




FIG. 29b 



EP 0 891 081 A2 



CO 

s 



I- Q 
o ^ 



o 






1- 






CL 


CL 


• • • 


cr 






o 


o 




CO 


CO 





T 



LU 

O Q 



cr 

D 
O 



00 LU 

LU a: 



z 

o 



o 
-J 

CL 
CL 
< 



Q 














a: 


n 






LU 


EC< 




si 


MR 

IVI u> 








D 


a: 




O oo 
CO O 


Z 


LU 






Q 




Q. 


cr 


< 






o 


LU 






LI. 


T 









uu 


LU 


O (T 


o 


a: uj 


q: 




D 


O 5 


O 


CO Z) 


CO 


LU z 


LU 


a: 


cr 












\ 




\ 




\ 










in 




LU 


LU 


UJ 


O Q 


o cr 


u 




o: LU 


01 




D 00 


D 


o o 


O 2 


O 


CO LU 


CO D 


CO 


LU a: 


LU 2 


LU 




01 


q: 




o 

LL 



(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(88) Date of publication A3: 

05.07,2000 Builetin 2000/27 

(43) Dale of publication A2: 

13.01.1999 Bulletin 1999/02 

(21) Application number: 98305380.2 

(22) Dateof filing: 07.07.1998 



(11) EP 0 891 081 A3 

EUROPEAN PATENT APPLICATION 

(51) lntCl7: H04N 5/44, H04N 5/00 



(84) 


Designated Contracting States: 


• Fujiyoshi, Yasuiiiro 




AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


1-1 Shibaura 1-chome Minato-ku Tokyo 105 (JP) 




MC NL PT SE 


• Sakiazaki, Yoshihisa 




Designated Extension States: 


1-1 Shibaura 1-chome Minato-ku Tokyo 105 (JP) 




AL LT LV MK RO SI 


• Shimoda, Kenji 






1-1 Shibaura 1-chome Minato-ku Tokyo 105 (JP) 


(30) 


Priority: 07.07.1997 JP 18140597 








(74) Representative: Litchfield, Laura Marie et al 


(71) 


Applicant: KABUSHIKI KAISHA TOSHIBA 


Haseltine Lake & Co. 


Kawasaki-Shi, Kanagawa-ken 210-8572 (JP) 


Imperial House 






15-19 KIngsway 


(72) 


Inventors: 


London WC2B 6UD (GB) 


• 


Yasuki, Seijiro 






1-1 Shibaura 1-chome Minato-ku Tokyo 105 (JP) 





(54) Intelligent digital television receiver 

(57) An intelligent digital television receiver for re- 
ceiving a video signal, an audio signal and a digital data 
transmitted in a digital broadcast, and for executing an 
application based on the received digital data by itself 
or in connection with the received video and or audio 



signal. The receiver has a controller for controlling exe- 
cutions of applications by generating events according 
to event start information bearing time information con-' 
lained in a digital data stream as an object which com- 
prises an element of the application and another con- 
troller for controlling executions of the application. 



CO 
< 

GO 



00 

o 

LU 



EP 0 891 081 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 98 30 5380 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
lo claim 



CLASSIFICATION OF THE 
APPLICATION (fnt.CI.5) 



EP 0 680 216 A (THOMSON CONSUMER 
ELECTRONICS) 2 November 1995 (1995-11-02) 

* abstract * 

* page 4, line 53 - page 5, line 8 * 

* page 9, line 27 - line 54 * 

* figure 1 * 

COUITIS F: "LA NORME MHEG, VIDEO A LA 

DEMANDE ET TELEVISION INTERACTIVE. THE 

MHEG STANDARD FOR VIDEO ON DEMAND AND 

DIGITAL TELEVISION SERVICES" 

REE: REVUE GENERALE OE L'ELECTRICITE ET DE 

L'ELECTRONIQUE, 

no. 4, 1 October 1995 (1995-10-01), pages 
33-39, XPOO053332a 
ISSN: 1265-6534 

* paragraph [02,1 

* paragraph [03.2 

* paragraph [03.3 

* figures 3,4 * 

WO 96 05699 A (ACTV INC) 

22 February 1996 (1996-02-22] 

* page 4, line 12 - line 31 * 

* page 11, line 28 - page 12, line 21 * 

* figure 2 * 

TSANG P H H ET AL: "THE MULTIMEDIA 

INFORMATION LINK CONTROL" 

PROCEEDINGS OF THE REGION TEN CONFERENCE 

(TENCON), BEIJING, OCT. 19 -21, 1993, 

vol. 1, 19 October 1993 (1993-10-19), 

pages 70-73. XPO00463232 

YUAN BAOZONG 

* abstract * 



Th e p f eaent ae areh repo i t li aJ b e en cfr a wn up hr ni) alaima 



1-10, 

13-15 



1-10, 
13-15 



1-10, 
13-15 



1-10, 
13-15 



Place d March 



THE HAGUE 



Datft o( completnn ol tn* •carch 

25 October 1999 



H04N5/44 
H04N5/00 



TECHNICAL RELDS 
S£ARCtCD (lnLa.6) 



H04N 



Berbain, F 



CATEGORY OF CfTEO DOCUMENTS 

X : partieuiaHy relevant V taken abne 

Y : partlculaHy mttvent * eombined with anottier 

dcMumsnt of the aanM oategory 
A : teclnnologioal baetatraund 
O : non-writtBn diteloeufe 
P : tntermediate dooumenl 



T : theory or principle underlying the invention 
E : eartier polent docunrent, but puaiished on, or 

alter the filing data 
D : document cited in tha opplioation 
L : document cited for other reason* 

k : meiT^er of the aame patent famly, aomiponding 
document 



EP 0 891 081 Ad 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 98 30 5380 



Thi3 annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Office ED P fife on 

The European Patent Office is in no way liable for these particulars whioh are merely given for the purpose of Information. 

25-10-1999 



Patent document 
ated in search report 



Publication 
date 



Patent family 
member{9) 



Publication 
date 



EP Q680216 



02-11-1995 



US 
US 
CN 
JP 
SG 



5548532 A 
5448568 A 
1114814 A 
8G4695Q A 
30364 A 



WO 9605699 



22-02-1996 



US 
AU 
AU 
BR 
CA 
EP 
JP 



5585858 A 
688496 B 
2290895 
9506316 
2173996 
0723729 
9504156 



20-08-1996 
05-09-1995 
10-01-1996 
16-02-1996 
01-06-1996 



17-12-1996 
12-03-1998 
07-03-1996 
05-08-1997 
22-02-1996 
31-07-1996 
22-04-1997 



For more details about this annex : aee Offidol Journal of the European Patent Office, No. 1 2/82 



This Page Blank (uspto) 



v: • t 



